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Abstract 

We are concerned with an M/M-type join the shortest queue (M/M-JSQ for 
short) with k parallel queues for an arbitrary positive integer k, where the servers 
may be heterogeneous. We are interested in the tail asymptotic of the stationary 
distribution of this queueing model, provided the system is stable. We prove that 
this asymptotic for the minimum queue length is exactly geometric, and its decay 
rate is the k-th power of the traffic intensity of the corresponding k server queues 
with a single waiting line. For this, we use two formulations, a quasi-birth-and- 
death (QBD for short) process and a reflecting random walk on the boundary of the 
k + 1-dimensional orthant. The QBD process is typically used in the literature for 
studying the JSQ with 2 parallel queues, but the random walk also plays a key roll 
in our arguments, which enables us to use the existing results on tail asymptotics 
for the QBD process. 

Keywords: Join the shortest queue, heterogeneous servers, stationary distribution, 
exactly geometric asymptotics, quasi-birth-and-death process, reflecting random walk. 



1 Introduction 

We consider a parallel queueing model in which customers join the shortest queue. If 
there are more than one queues whose lengths are shortest, then we assume tie break 
with equal probabilities. We denote the number of queues by k (> 2). It is assumed 
that customers arrive according to a Poisson process, and each queue has a single server, 
and its service times are i.i.d with an exponential distribution. Here, those servers may 
have different mean service times, that is, they may be heterogeneous. We refer to this 
queueing model as an M/M-type join the shortest queue (M/M-JSQ for short). 

We are interested in the stationary distribution of the queue length for the M/M-JSQ. 
However, its analytic derivation is known to be hard, and theoretical interests have been 
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directed to the tail asymptotic of the stationary distribution. For k = 2, this problem 
has been well studied. Kingman studied the M/M- JSQ with 2 parallel queues having 
homogeneous servers. He proved that the stationary distribution of the minimum queue 
length has an exactly geometric asymptotics and its decay rate is equal to the square 
of traffic intensity of the corresponding M/M/2 queue with a single waiting line, where 
exactly geometric asymptotics means that the tail probability is asymptotically propor- 
tional to a geometric function. Many researchers obtained similar geometric asymptotics 
for more general models with two parallel queues. The case of heterogeneous servers is 
studied in 15 1. Foley and McDonald j^] considered the generalized shortest queue which 



has a Poisson stream dedicated to each queue in addition to a Poisson stream which 
chooses the shortest queue. They obtained the stability condition and exactly geometric 
asymptotic under some extra conditions. This model was further studied in jg, In 
particular, Miyazawa jsf described the generalized shortest queue by a two sided double 
quasi-birth-and-death (QBD) process, and derived the tail decay rates without any extra 
condition. Sakuma [14[ considered two parallel queues with a common phase type ser- 
vice time distribution and a Markov modulated arrivals, and derived exactly geometric 
asymptotic under a certain condition. 

All those studies for JSQ assume two parallel queues. We consider the case where there 
are more than two parallel queues, that is, k queues with k > 3. Puhalskii and Vladimirov 



121 ] studied the tail asymptotics for much more general k parallel queues in which there 
are multiple classes of customers who can only choose the shortest queue among queues 
assigned to them. They derived the large deviations principle for this generalized model. 



However, they do not answer any explicit asymptotics even for k = 2. Sakuma [13( also 
studied k parallel queues with JSQ discipline, but this model is allowed to have jockeying 
when the maximum difference among queues is greater than a given threshold level. Due 
to this jockeying assumption, the problem is reduced to one dimensional queue, and the 
standard technique can be applied to get tail asymptotics. 

For the M/M- JSQ with k parallel queues, it is easy to guess that the tail decay rate of 
the stationary distribution for the minimum queue length is the fc-th power of the traffic 
intensity of the corresponding k server queue with a single waiting line because all the 
queues should be balanced. However, there has been no proof for k > 3 as far as we 
know. This may be because there is no satisfactory method for tail asymptotics on the 
stationary distribution for more than two correlated queues. 

The aim of this paper is to prove this conjecture. This will be done by obtaining exactly 
geometric asymptotic. For this, we employ two formulations. We first consider the exact 
geometric asymptotics using a discrete time QBD process, which has two components, 
level and background. The level is one dimensional, and represents a characteristics of 
interest for tail asymptotics. The background state has all the information for the process 
to be Markov. We define the level by the minimum queue length for the M/M- JSQ with 
k parallel queues while background state is a set of differences between the queues lengths 
and their minimum. Then, we have the QBD process, and the stationary distribution is 
represented by the so called matrix geometric solution. This solution can be used to derive 
the exactly geometric asymptotic. However, we need to verify certain conditions for this 
derivation which are not always easy to verify. In particular, one of them is involved with 
the tail asymptotic of the marginal distribution at level zero, which is generally unknown. 
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To overcome this difficulty, we use another formulation. We take the same state space 
as that of the QBD process. Thus, each state is a k + 1 dimensional vector at least 
one of whose entries vanishes. We consider this process as a reflecting random walk 
on the boundary of the k + 1 dimensional nonnegative integer orthant. This boundary 
is composed of 2(2 fe — 1) faces depending on which entries vanish. This random walk 
provides us a different tool for solving the tail asymptotic problem. For this, we use 
moment generating functions for describing the stationary equation instead of the matrix 
geometric solution. Of course, it is very hard to analytically derive the moment generating 
function of the multidimensional stationary distribution. Instead of doing so, we only 
consider its convergence domain, similarly to our recent papers 0, S|. We can not find 
the whole domain, but can get sufficient information to apply the tail asymptotic result 
of the QBD process. 

The rest of this paper is organized as follows. In Section [21 we formally introduce a 
Markov chain for the shortest queue and formulate it in two ways, the QBD process and 
reflecting random walk. We then present a main result, the exact geometric asymptotic 
for the M/M-JSQ with k parallel queues (Theorem 12. ip . As a corollary of this result, 
we also derive a rough asymptotic for the marginal distribution of the minimum queue 
length (Corollary 12. ip . In Section [3j we prove the main result using one proposition and 
five lemmas. The first two lemmas are on the QBD process, and proved in the appendix. 
The last lemma plays a key roll for our proof. It is proved in Section HI using further 
lemmas. We give some concluding remarks in Section 



2 Modeling and exactly geometric asymptotics 

We consider a queueing model with k parallel single server queues, where each waiting 
line has infinite capacity, and we index those k queues as 1,2, ... ,k. Customers arrive 
according to a Poisson process with rate A and join the shortest queue, where ties are 
broken with equal probabilities when there are more than one shortest queues. At the 
i-th queue, the customers are served according to first-come first-served discipline, and 
their service times are independent and exponentially distributed with mean /i" 1 . Thus, 
the severs may not be homogeneous. This queueing model is referred to as an M/M-type 
join the shortest queue (M/M-JSQ) with k parallel queues (see also Figure [1]). 
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Figure 1: M/M-JSQ with k parallel queues 
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We denote the index set of queues by J, that is, 

J={l,2,...,k}. 

For each t and i e J, let Li(t) be the number of customers in queue i including a customer 
being served, and let 

L{t) = {L 1 {t),L 2 {t),...,L k {t)). 

It is easy to see that {L(t); t £ M + } is a continuous time Markov chain with state space 
where M + and Z + are the sets of all nonnegative real numbers and integers, respectively. 
We denote the traffic intensity of this queueing model by 

A 

and assume that 

p<l, (2.1) 



which is known to be the stability condition (see, e.g., |2J). Since the total transition 
rate from each state is bounded by A + Yli=i Pit we can construct a discrete time Markov 
chain which has the same stationary distribution as that of {L(t)} by uniformization. We 
normalize A + Yli=i Pi without loss of generality as 



k 



\ + Y,Pi = 1 - (2-2) 



i=l 

We denote this discrete time Markov chain by {Lf, i = 0, 1, . . .}, where 

Li = (La, L12, . . . , Ltk). (2.3) 

In this paper, we refer to this process as an original queue length process. 

In the rest of this paper, we consider this discrete time process. The state transitions 
of Li are a bit complicated because they depend on how L^s are ordered. Thus, we 
describe it in a slightly different way. Let 

M e = min L«, Y e = (Y ei , Y £2 , ...,Y ek ), t = 0, 1, ... , 

ie J 

where = — Mi for % £ J. Let {Zf, i = 0, 1, . . .} be a pair of Mi and Y#, that is, 

Z e = (M t ,Y e ), 

which is just another expression for {Li}. Obviously, {Zf,£ = 0,1,2,...} is a discrete 
time Markov chain which takes values in Z+ +1 . 

The process {Zi} is convenient because of two reasons. First, it can be considered 
as a quasi-birth-and-death process, QBD for short, if we view Mi as level and Y i as 
background state. Secondly, it can be considered as a reflecting random walk. This 
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simplifies our arguments while keeping accurate mathematical expressions in the boundary 
faces of k + 1-dimensional nonnegative integer orthant. 

Let us describe the process {Zi} as a k + 1-dimensional reflecting random walk. We 
first partition its state space. Let /C = {U C J; U ^ 0}. For U G /C, we define the 
following boundary faces. 

S +u = {u = (u ,ui,u 2 , • • -u k ) G Z+ +1 ; u > l,Ui > l,i G J \ U, uj = 0, j G U}, 
S ou = {u = (u ,«i, w 2 , • • G Z+ +1 ; n = 0, ^ > l,z G J\ f/, it^ = 0, j G £/}. 

Denote the boundary of Z+ +1 by <9Z+ +1 , that is, 



Then, <9Z fc+1 = U{/ e x:(5 + f/ U S'oc/), and {Zg} only stays on the boundary 9Z^ +1 . Thus, 
the state space of Zi is given by 



Note that Zi G S+u if C/ is the set of indices of the shortest queues and Mi > 1. Similarly, 
Zi> G Squ implies that U is the set of indices of the shortest queues and Mi = 0. 

Let us consider the distribution of increment Zi + \ — Zi. It only depends on the bound- 
ary face to which Zi belongs. To give its distribution, we use the following notations. For 
i G J, let e, be the fc-dimensional row vector whose i-ih entry is unit and the other entries 
vanish (e.g., ei = (1, 0, . . . , 0)), and let 1 be the k- dimensional row vector whose all entries 
are units, i.e., 1 = (1, 1, ... , 1). We denote the number of elements of set U by \U\. For 
each U G /C, we define the random vector X^ +u ^ taking value in (j, v) G {0, —1, l} fc+1 as 
follows, for \U\ = 1, 



{u = (u , Ui,...,u k ) e Z+ +1 ; 3' 



\i G {0} U J, Ui 



0}. 



S — Uu<£K.(S+u U S Q u)- 




(2.4) 



and for \U\ > 2, 




(2.5) 




Similarly, let ' be the random vector such that, for \U\ = 1 

f A, (j,v) = (l,-l + ei),z G U, 



(2.6) 



(2.7) 
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where is a null vector. Note that X ( ' represents the increment when the queues with 
indices in U are empty. Then, {Zg} can be obtained as 

Z i+1 = Z t +J2(x ( e +u) l(Z i e S +u ) + Xf u) l(Z e E Sou)) , (2.8) 

ueic 

where X^ U ^ and X^ U ^ are independent copies of X^ +u ^ and X^ ou \ respectively, and 
l(-) is the indicator function. This {Zi} is referred to as a reflecting random walk for the 
JSQ. 

By the stability condition (12. ip . {Z^} has a stationary distribution. Denote a random 
vector subject to this distribution by Z = (M,Y). Then, (12. 8p yields 

z = z + E ( xi+u)l ( z e S+u) + x^ u h{z e S ou )) , (2.9) 

ueic 

where = stands for equality in distribution, and X < - +c/ - ) and X^ ou ^ are assumed to be 
independent of Z . The stationary equation (12.91) plays a key roll in our arguments. 

Let 

n = {h = (h u h 2 ,..., h k ) G Z k + ; 3t eJ,h i = 0}. 

Obviously, H is a state space for Y and S = Z + x %. We are ready to present our 
main result of this paper which will be proved in Section |3] using results in Section H] and 
Appendices. 



Theorem 2.1 For the M/M-JSQ with k parallel queues satisfying the stability condition 
(12. ip . we have for each h e 

lim p- kn F(M = n ,Y = h) = c h , (2.10) 

n—>oo 

where is a positive constant. 



For two parallel queues with homogeneous severs, this theorem was firstly obtained 
by Kingman js| by using analytic functions. It is also known for two parallel queues with 
heterogeneous servers (e.g, see [HI]). Similar results were obtained for two parallel queues 
under more general setting; (e.g., see 0,0,0 , OH, [l5| and references in those papers). Many 
of them use the QBD processes and their limiting behaviors (e.g., see 10|). 



Corollary 2.1 Under the same assumptions of Theorem 12. 11 



lim -logP(M = n) = \ogp k 

n— >oo n 



(2.11) 



This corollary is not immediate from Theorem 12.11 because (12.101) only implies that 
the limit infimum of -logP(M = n) is lower bounded by log /A We will prove it in 
Appendix [El 
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3 Proof of Theorem 



2.1 



For the proof of Theorem 12 .11 we use two formulations, the QBD process and the reflecting 
random walk for the JSQ. We first discuss basic results on the exact asymptotic for the 
QBD process (see Proposition 13.11) . We next consider the convergence domain for the 
moment generating function of stationary distribution. For this, we prepare some lemmas. 
The last lemma among them has a key roll in our arguments, which will be proved in 
Section HI Finally, we prove Theorem 12.11 in Section 13.31 



3.1 QBD process and sufficient conditions for geometric tail de- 
cay 

We first present the tail asymptotic result for the QBD process known in the literature 
0, E3]- For this, we use some matrices. For i — 0, ±1 and i = 0, 1, 2, . . ., define infinite 
dimensional matrices B , Ai as 

[B ] hM = P(Z m = (0, h')\Z t = (0, h)), h, ti G H, 
[Ai] hth , = P(Z m = (n + i, h')\Z t = {n, h)), h,h'eU,n> I. 



Then, the QBD process {Zg} has the following transition probability matrix. 

/ B A +1 \ 

A-i A A +1 
F ~ A_i A A +1 



V 



We assume the stability condition ( 12. ip . and therefore the stationary distribution exists. 
We denote it by row vector 7r. 

For the QBD process, it is important to distinguish level from background state. For 
this, we partition the stationary vector 7r as (ir , 7r 1; . . .) according to level. That is, 

[7z n ] h = F(M = n,Y = h), 

for n G Z + and h G "H, where [Tr n ]h denotes the h-th entry of 7r n . As is well known (e.g., 
[5], EH), the stationary distribution is known to have the following matrix geometric form: 



7r n = ir R n , n>l, 
where R is the minimal nonnegative solution of the following equation: 

R = A +1 + RA + R 2 A_ 1 . 



(3.1) 



(3.2) 



When the size of R is finite, we can see that the tail decay rate of (13.11) is obtained as 
the maximal eigenvalue of R. Otherwise, this is not always true. Thus, we need certain 
extra conditions here. Such conditions were firstly obtained in 15|, and refined and 
generalized in 10]. The following result for the geometric tail decay are the specialization 
of the results in 10] to the QBD process (see Theorem 2.1 of [sj). 
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Proposition 3.1 Assume that A = A_\ + Aq + A + i is irreducible and aperiodic, and 
that the Markov additive process generated by {Af,£ = 0, ±1} is 1-arithmetic. If there 
exist a > 1 and positive vectors x and y such that 

xA*(a) = x, A*(a)y = y, (3.3) 
xy < oo, (3.4) 

where A*(z) = z~ x A_\ + A + zA + i for z ^ 0, then R has left and right eigenvectors x 
and r = (I — A — RA^i — a~ l A_i)y, respectively, with eigenvalue a -1 . Furthermore, if 

7r y < oo, (3.5) 

then we have the following geometric tail asymptotics for the stationary distribution: 

lim a n 7r n = —^—x. (3.6) 

n— >oo XT 

Remark 3.1 Both irreducibility and aperiodicity of A are easy to verify for our queueing 
model. Furthermore, the 1-arithmetic property is directly verified, that is, for each h G "H, 
the greatest common divisor of 

{h + £ 2 H h h\ [M^h,h\M^m x • ■ ■ x [Ae x ] h ^ u h, 

where i > 1, l m — 0, ±1, m — 1, 2, . . . , i, h n e H, n — 1, 2, . . . ,i — 1} 

is shown to be one. 



It is not very hard to find positive vectors x and y satisfying conditions ( I3.3P and 
(13. 4p . We first derive the a and the right invariant vector y in (13. 3 p 

Lemma 3.1 Let yh = p~ hl for h E H. Then, a = p~ k and y = (y^) h G H) satisfy 
A*{a)y = y. 

This lemma is proved in Appendix [A] We next consider left invariant vector x and 
(13. 4p . Let A y be the diagonal matrix whose h-th diagonal element is yh for h G "H and 
the other entires are 0. Since y is the right invariant vector of A*(p~ k ), A~ 1 A^(p~ k )A y is 
a stochastic matrix. We have the following lemma, which is proved in Appendix IB1 

Lemma 3.2 The stochastic matrix A~ 1 A ;); (p _fc )A y is positive recurrent. 

Using these lemmas, we will verify the conditions (13. 3p and (13. 4 p in Section 13.31 

We finally consider the condition (13. 5p . However, we need much effort to check condi- 
tion (I3.5p since it includes the unknown vector 7r . For this, we will consider a convergence 
domain of the moment generating function for the JSQ in Section 13.21 In the next sub- 
section, we only present results on the domain as lemmas, and prove them in Appendices 
ICl and [D] and in Section HI 
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3.2 Stationary inequality for moment generating functions 



For 6 = (6q, #i, 82, ■ ■ ■ , 6k) £ where IR is the set of all real numbers, let tp(0) denote 

the moment generating function of the random vector Z = (M, Y) in (I2.9p . that is, 



<p{0) = E(e 



(3.7) 



where ab denotes the inner product of vectors a and b. We are interested in the conver- 
gence domain of tp which is denoted by T>, i.e., 



V = {Oe R k+1 ;<p(0) < 00}. 



(31 



In what follows, we will study the domain T> by using the stationary equation for the 
moment generating function. To this end, we introduce some notations. For U G JC, 
let 7 + [7 and 70c/ be the moment generating functions of the random vectors X^ +u ^ and 
X^ ou \ respectively, that is, 



1+u {0) = E(e' 



From equations (I2.4p -( l2~7| . we have 



lw {6) = E(e 



ex<~ ou ^ 



G 



j€J\U 



E w\ Ae ' 1 + E ^ e ~ dl + Ys^ e ~ eo+J2jeJW}03 for m ^ 2 ' 

i&J ' ' ieJ\u ieu 

' \ e e °-^^\u 8 J + ^.e-ffi +At . f or \u\ = 1, z g U, 

j£j\U 

E y^ Aeei + E ^ e ^ 1 + Z> for m ^ 2 - 



(3.9) 



(3.10) 



«e(7 1 1 iej\u ieu 

We further define two moment generating functions ip + u and ipou as follows: 

<p +u (0) = E(e ez l(ZeS +u )), 
<p w {0) = E(e ez l(Z G S ou )), 

for G M fe+1 . 



(3.11) 
(3.12) 



Remark 3.2 For each [/ G /C and G K. +1 , (f + u(0) does not depend on the parameter 
#i for i G £/ since the expectation in (13. lip is taken over the event {Z G S+u}, i-e., ^ = 
for all i G £7. Similarly, tpou(0) does not depend on the parameters #0 and ^ for i G {7. 



From (I3.9P and (I3.10p . for all U G /C, it is easy to see that 7 + [/(0) and 70c/ (9) are finite 
for all 6 G M fc+1 . Thus, from (I2.9p . we have a stationary equation of moment generating 
function as long as <p{0) is finite. 



■0) = (lM°)vM0) + Jou{e)tp ou (0)) . 



(3.13) 



(76/C 
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Furthermore, partitioning <p(0) concerning each boundary, we have the following decom- 
position: 



?(0) = X> +1 ,(0) + ¥>oeK0))- 



(3.14) 



From fl3TT3|) and (j3TT4) . we get 



((1 - l + u{0))<P+u{0) + (1 - 70^(0) W(0)) = o. 



(3.15) 



The stationary equation (13.151) holds at least 6 < 0. 

We consider the convergence domain of the moment generating function f(9) for 
> 0. We first prove that the distribution of Z has a light tail. For this, we will use the 
idea of Foley and Mcdonald 0], in which they obtain a similar result for k = 2. 

Lemma 3.3 Under the stability condition (12.11) . there exists an e > such that E(e e ^ i=1 Li ) < 
oo, where Lj = M + Yi for z G J, and therefore <^(0, el) < oo. 

The proof of this lemma is deferred to Appendix From this lemma, we find a 
confirmed region for the convergence domain of the moment generating function tp in the 
positive orthant. Starting with this region, we will expand the confirmed region of the 
convergence domain T>. To this end, we consider the stationary equation (13.151) . However, 
we only know that the stationary equation (13 . 1 5[) holds with 6 < 0. Thus, we can not 
use the stationary equation (13.151) directly. Instead of doing so, we derive inequalities on 
the stationary distribution. For this, we recall that JC is the set of all subsets of J except 
for empty set. 

Lemma 3.4 For fix e we have the following results. 

(a) If ip 0U (6) < oo and 1 — j + u(0) > for all U & JC, then we have 



(3.16) 




(b) Let A be a subset fC. If 



7+a (0)<l,7oa(0)<l, 



U efC\A, 
U' e A, 



(3.17) 
(3.18) 



then we have 



((1 - l+u (0) WW + (1 - 7ocK0) WW) 



ugk.\a 



< ((7+t/'(6>) - l)<P+u>{0) + ( 7 oa'(0) - l)<Pou>(9)) < oo. 



(3.19) 



U'eA 



(c) If all the conditions in either (a) or (b) hold, then ip(0) < oo. 
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Remark 3.3 If ip + u{0) and tpou(0) are finite for all U £ K., then the stationary equation 
( 13 . 1 3[) is satisfied, and we have (I3.16P and (I3.19P with equalities. The important claim of 
this lemma is that (13.161) and (13 .191) hold even if the finiteness of the left hand sides are 
unknown. 

This lemma is an adaptation of Lemma 6.4 in jsj], but we prove it in Appendix ID1 for 
this paper to be selfcontained. Using these inequalities, we obtain a part of domain T> to 
be sufficient for our purpose. We prove the following lemma in Section HI 

Lemma 3.5 For (770, 771) € R 2 , if 

r/ <logp" fc , 771 < ^— ylogp - * = log/rl + ^3T l0gp1 ' ^ 3 ' 20 ^ 
then we have (p(rj , rjil) < 00. 

This fact will be used to verify the condition (I3.5p . We are now ready to prove 
Theorem 12.11 using Proposition 13.11 

3.3 Verifying the sufficient conditions in Proposition 13.11 

From Lemma [3.11 we already obtain a = p~ k and y = (yh), where yh = p~ hl for h G %. 
So, we need to check the conditions (13. 3p . (13 .4p and (13. 5p . From Lemma |3~2| the stationary 
distribution of A~ 1 74^(p~ fc )A y exists, and denote it by is, that is, 

vA- l A*(p- k )A y = v. 

Thus, the condition (13. 3p holds with x = vAy 1 . In addition, we have 

xy = vA y X y = 1. 

Hence, the condition (13.41) is satisfied. 

We finally verify the condition (I3.5p . We have the following equation. 

heH heH 

Since </? is the moment generating function of stationary distribution, for (?7o, ^1) £ K 2 , 

00 

n=o hen 

From (13721]) and f l3T22|) . we have 

ir y<^,\ogp- l l). (3.23) 

By Lemma IBTBl we have (f(0, log p~ x l) < 00, and the left hand side of (I3.23P is finite. Thus, 
the conditions in Proposition 13.11 are satisfied. This completes the proof of Theorem 12.11 
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4 The proof of Lemma 



S3 



The main object of this section is to prove Lemma [3. 51 Let 

Z> (2) ^(7to,77i)eR 2 ;(»fo,T7il)eX>}. 

That is, is the projection T> to the two dimensional hyper plane. Then, for (7/0,771) G 
IR 2 , 72(7/05 771 1) < 00 is equivalent to (r/ , 771) G "D^. Thus, we will show that (770, 771) G T>^> 
under the condition ( 13.20}) . We iteratively find a sequence of vectors £ 1; C21 ■ ■ ■ iC m f° r 
some 777. > 1 such that C, t G T>^ for 1 < I < m and (7/0,7/1) < C, t Our approach 
is similar to 0, S|- One may think that we can still use the two dimensional iteration. 
However, things are not so simple because of the /c+l-dimensional nature of the stationary 
distribution. In particular, we must consider the k + 1 dimensional moment generating 
function when we expand the confirmed region in the direction of 7/1-axis. To overcome 
this issue, we prepare some technical lemmas. 

4.1 The first step for expanding the confirmed region 

We consider to iteratively expand the confirmed region for tp(6) < 00 by using Lemma I3~4"l 
For this, it is important to suitably choose A for Lemma 13.41 For each V G /C, let 

Q{V) = {U G K- V n U ± 0}, 

and denote /C \ 0(V) by Q C (V). It follows from Lemma I3T41 with A = G(V) that 

7 +C7 (0)<l,7 OC /(0)<l, UeG c (V), (4.1) 
<p +u (6) < 00, ip ou {0) < 00, U G g(V), (4.2) 

imply that f(0) < 00. 

We next consider to minimize the number of the conditions in (14. 2 p to be verified 
by restricting to the case that \V\ = 1. To this end, we introduce some notations. For 
each i = 0, 1, let {Ci,j',i = 0, l,j G J} be a 2 x k matrix. For V G fC, let C(^) be the 
k + 1-dimensional vector whose components are give by 

{Co,|V| for i = °; 
Ci,|V| ^ ^ G V, (4.3) 
for % G J \ V. 

Then, we have the following lemma. 

Lemma 4.1 For each % — 0, 1, assume that Qj is nonincreasing in j G J and 

(CI) -y+u(C(V)) < 1 and J 0U (C(V)) < 1 for each V G /C \ {J}, that is, V G /C satisfying 
\V\ < k-1, and U G ^ C (V^). 

Then, the condition: 

(C2) ^+c/(C(^)) < 00 for each V G /C \ { J} satisfying \ V\ = 1 and each U G ^(V) 
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implies that 



(Co,i>Ci, fc -i)eZ> (2) - 



(4.4) 



Remark 4.1 For V E fC\ {J} such that \V\ = 1, U E Q{V) if and only ]fU = V, and 
therefore, for this U, (p + u(C(V)) does not depend on the elements of C(V) except for first 
entry, i.e., Co,i- 

Proof. For (Co,fc-i, G,fc-i) £ ^ 2 , from fl3.14[) . we have 

<p(Co,k-i, Ci,*-il) = ^2 (^oc/(Co,fc-i, Ci,fe-il) + y+y(Co,fc-i, Ci,fc-il)) • (4-5) 

Since (CI) holds for V E /C \ { J}, (14. 4p is obtained if we verify 

^ +C /(CO0) < oo, VEJC\{J}, UeG(V), (4.6) 

by Lemma 13.41 

Assume the condition (C2). We inductively verify (14. 6p on the value of \V\, where 
1 < \V\ < k - 1. gU) holds for \V\ = 1 by (C2). For a fixed £, where 1 < £ < k - 1, we 
assume that, for V E JC satisfying 1 < \V\ < £, 

<p+u(C{V)) < oo, <pou{C{V)) < oo, U E Q{V). (4.7) 

If we can show that ( 14. 7ft for V E JC such that \V\ = £+1, then the induction is completed, 
and therefore we have ( 14.61) . 

Arbitrarily choose U' E Q{V) for V E K satisfying \V'\ = £ + 1. We recall that 
the expectations in and foui are taken over the events {Y^ = 0; i E U'} and {M = 
0} fl {Yi = 0; i E U'}, respectively. Hence, we have 

<P+w(C(W) < <P+u>(C(y \ U')), tpw{C(V)) < V0 u'(C(V \ U')), (4.8) 

since Co,|v| < (o,\v\u'\ and Ci,|v| < Ci,|V'W| by the nonincreasing assumption (see also 
(Ojl ). We note 'that |V" \ < £ for [/' e £?(V") since V nV ^ 0. Thus, from the 
induction assumption (14.71) for \V\ < £, (14. 7p is satisfied for \V\ = £+ 1. This completes 
the proof of the lemma. □ 

From this lemma, we have the following fact, which will be used to expand the con- 
firmed region. 

Lemma 4.2 If (rj , 0) E £> (2) for rj > 0, then (rj , j^Vo) e £> {2) . 

Proof. We will use Lemma I4TTI For this, let Co,j = Vo an d Ci,j — y^o- Then, for z = 0, 1, 
Cij is nonincreasing in j. Moreover, from Remark 14.11 we have (C2) from our assumption. 
If we can verify (CI), then for ( j = rjQ and (\j = jr] , all conditions of Lemma [4.11 are 

satisfied, and therefore, (770, ^zy^o) £ T>( 2 \ 
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In what follows, we check the condition (CI). For this, we consider the case U £ Q C {V). 
We recall that V fl U = 0. Thus, for j £ J, ( j = r) and £ij = 4?7o, 

[C(^)]i = ([C(Wey) + [CTO«6j\y)) = o, Vietf, 

E = E ([C(V)]*l(i e V) + [C(V)] 4 1(< 6J\V)) = ijb, |tf | = 1, 

i6J\t/ i£j\U 

E = E (ICWW e ^) + [C(^)L-i(j e J \ V)) = V* £ Z7, 

me-Wb = J- & (e~M v M(i eV) + e~^H(t £ V)) 
i£j\u ieJ\u 

= E^ e "^°+ E 

i£V ieJ\(UUV) 

For any i satisfying U = {i}, that is \U\ = 1, substituting these equations into ( 13 .9p and 
(13.1 Op . we have 



jeJ\u 

= A + E^ e ~^"°+ E Vj + Vi 

jev jeJ\(uuv) 

< A + E^'+ E to + fr 

jev jej\(uuv) 

k 

= A + E/^i 

i=i 

= 1, 

7o[7 (C(F)) = Ae^i-^^^Ii + ^ ^e-KWi + ^ 

= a + E/^~^°+ E Vj+fr 

jev j£j\{uuv) 

< 1, 

where we used the assumption (12. 2J) . On the other hand, for \U\ > 2, we have 

1+u (c(v)) = Y,w\ XeK{v)h+ E ^ e ~ [c(y)]l + E^ e " Co ' |v ' l+EjeA{i}[c(y)]j 

ieu ' ' ieJ\u ieu 

= A + E^e"^ r '°+ e ^ + E^ 

iev iej\(f/uy) ietf 

< 1. 

lou(C(V)) = E ,4 Ae^+E^ K(V)k + E^ 

= A+E^ e ~^°+ E ^ + E^ 

i&V ieJ\(UUV) i&U 

< 1. 

Hence, for each fixed V, we have (CI). This completes the proof. □ 
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4.2 Iterations for expansion 

We next consider two dimensional marginals of the moment generating functions (13. 9p 
and (13.1 Op . For each U E /C and (771, 772) S K 2 , we define the moment generating functions 

(2) A (2) 

J+u and 7^ as 

r + u{Vo,Vi) = T+c/^o^il), %u(Vo,Vi) = JouiVo^i 1 )- 

For U E K,. let 

r^ = {r 7 = (r / o,r /l )GM 2 ; 7 S(r7)<l}, 
0T$r = {77 = (770,771) G K 2 ;7S(r?) = I}- 

Then, we have the following facts. 

Proposition 4.1 Under the assumption of Theorem l2.ll we have the following properties. 

(i) T^jj is a convex set in M 2 for U G /C. 

(ii) {rji G R; (770,771) G 9r\^} is bounded for each fixed 7?i_i and i — 0, 1 and [/ G /C 
such that |[/| = 1. 

(iii) (0,771) G dr\_jj for some 771 > 0. and U E JC satisfying \U\ = 1. 

(iv) For U E fC such that Z7 > 2, {771 G M; (770, 771) G <9r^, 377 G M} is bounded from 
above. 

(v) All the curves dT^jj for U E K, intersect at (0,0) and (logp~ fc , log p _1 ). 

We obviously see (i)-(iv). For example, (i) is obtained because 7^ is a convex function. 
Furthermore, (v) is obtained by letting #0 = logp _fc and 9\ = 6 2 - ■ ■ = Ok = logp -1 in 
(13. 9j) . So far, we omit a detailed proof of this proposition. In Figure [21 for k = 2, we 
depict the convex curve dT^jj and the region where the condition (13.201) holds. 

Using Lemma 14. 2[ we iteratively find nondecreasing point such that the moment gen- 
erating function <p (770,7711) is finite. We illustrate our iteration in Figure El For this, 
we recall that there exists fji > such that <p(0, ^j 1) is finite by Lemma 13.31 Let 
ry(°) = (0,r)S 0) ) and for t = 1, 2, . . . , 

= (r)^,V?) = arg sup {r^T^fa) < ^ e ^771 < T/f"^}, (4.9) 
(vo,vi) 

# ) = (tf\#)-(tf ) ,^ T tf ) )- (4.10) 
Then, from Proposition 14.11 we have the following property. 
Lemma 4.3 rj^' is nondecreasing in £ = 1, 2, . . .. 
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((Uogp- 1 



a r (2) 
° l +{2} 




+{1,2} 



Figure 2: The domain and iteration to expand the finite domain 

Proof. From ffl~TUj) . it is sufficient to show that 77^ < r/^ +1) for all i = 1, 2, . . .. We 
first note that, from (i) and (iii) of Proposition l4.lt 

7Sk0,#)<l, We/Cs.t |f/| = l. 

From this inequality and the properties (i), (iv) and (v), for all i = 1, 2, . . ., it is easy to 
see that < rfo < \ogp~ k . In addition, by (i), (ii), (iv) and (v) of Proposition 14. 1} 



r/W = argsup^o; 7^(77) < 1, U e K, \U\ = 1, < Vo < logp"*,^ < 77}^}- (4.11) 

From (14. lip , if we can obtain rji < fff 1 for all £ — 1, 2, . . ., we have 77^ < Vo^ +1 \ an d the 
proof is completed. From convexity and boundedness of 7^ (see properties (i) and (ii) 
in Proposition 14. ip . we obtain 



(t-iy 



7$fa W ) = l, 3[/ e /C, |C/| = 1, 



(4.12) 



for £ = 1,2, . . .. Thus, from convexity of 7^, fl4TTT|) . ( KW> and < 77^ < logp" fc , we 
obtain, 



(0 



1 



CO -W 



(4.13) 



for all 



1,2 



□ 



From Lemma 14.31 and (14.111) . we can see that 77^ and 77^ converge to some points. 
Denote them by rj^ and rj^, i.e., 



r /o°° ) = lim Vo\ Vi° ] = Jim 



Then, the finite domain of the moment generating function is obtained as follows. 



Lemma 4.4 If (770,771) < (77 °°\ rf^) , then (770,771) e 2)( 2 ). 
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Proof. By induction for £, we will show that, for any £ = 1, 2, ... , 

(Vo,Vi)e^ 2 \ (Vo,Vi)<{v { o\v?)- (4-14) 

For £ = 1, we first show that (770,771) G for (770,771) < (VqiVi^)- For all U E )C, 
ipou(Vo j ^i 1) is finite since the value of y?oc/ does not depend on the first entry (see 
Remark 13.21) and 771 < rjf\ From this and (j4.9p . for sufficiently small e ,e 1 > and 
(Vo,Vi) = (Vo ~ e o? ? 7i 1 ' ) — ei), we can use (a) of Lemma 13.41 and we have ^(f]^ — 
e o> (^i ~ e i)l) < 00 • Hence, (770,771) G X^ 2 ) for (770,771) < (Vo,Vi )- We are ready to 
obtain f!4.14p for £ = 1. We recall that 

(^ 1) ,# , )=(^ 1) ,^ 1) ). (4-15) 

In addition, the conditions in Lemma [4.21 hold with r] < t)q since 771 > 0. Thus, from 
Lemma Upland (Q5]l . we have (1434]) for £ = 1. 

Suppose that f !4.14j) satisfies for £ = £' > 2. Similarly to the arguments for £ — 1, we 
have (7/0,77!) G P*- 2 -* for (770,771) < (77^ 77^ +1 '). Thus, conditions in Lemma 14.21 hold 
with 770 < 77^ again, and we obtain (" 14. 14[) for £ = £' + 1. □ 

4.3 The last step of the proof 

By Lemma [4.41 and r\\^ = j^if]^, it is sufficient to prove 7/0°°^ = logp~ fc . From ( 14. lip , 
we clearly have 

Vo^ <logp" fc - (4.16) 
Suppose that ryQ 00 " 1 = a < logp _fc . Then, it is easy to see that 

^ ) u (a, v P) = l, 3Ue1C,\U\ = l, 
^U^rjf^Kl, VU' ^U,\U'\ = 1, 
for some £' > 1. Thus, from (14.131) . we have 

-a > 77I ; . 

Moreover, from Proposition 14. 1 1 and ( 14. lip , for any U G /C, there exists a small e > such 
that 

T < 2 » (a -«, ,<")<1. 

From (l4~T0p . 

-(•«') 1 c n ^ {(■') 

m = -j—\y a - e )>Vi ■ 

since e is sufficiently small. Thus, by Proposition 14.11 there exist 5 > and 771 < 77^ ^ such 
that 

7 S(a + 5,77 1 )<l, VC/G/C. 
This is a contradiction. From this and (14. 16ft . we obtain = logp~ fc . 
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5 Concluding remarks 



First of all, we note that our assumption on the tie break can be relaxed. We have as- 
sumed that arriving customers choose one of the shortest queues with equal probabilities. 
This assumption makes our arguments simpler, but is not essential. Namely, for each 
configuration of the shortest queues, we can replace it by any distribution. 

In this paper, for the M/M- JSQ with k parallel queues, we obtained the exact tail 
asymptotics of the stationary distribution for the minimum queue length given the differ- 
ences of queue length between each queue and minimum queue. It may be interesting to 
find Ch of (12.1 Op to see the joint distribution of the background state in the asymptotic 
formula. For this, we need to derive the left invariant vector x in (13.31) because Ch is 
proportional to the h-th. entry of x. For k = 2, this left invariant vector is obtained in jfjj]. 
However, this computation is difficult for the case k > 3. We leave it as an open problem. 

In our proof of Theorem 12. 11 we obtained the subset of the convergence domain T>. This 
subset is still useful as we have seen in the proof of Corollary 1 2. 1[ However, if we completely 
derive the domain P, we could do much better job. For example, we may have another 
type of tail asymptotics, e.g., joint queue length and marginal distributions. However, 
this would be a hard problem since our reflecting random walk is multidimensional. This 
challenging problem is left for future work. 

Another challenging problem is to generalize the M/M- JSQ to have dedicated streams. 
For k = 2, the rough asymptotics of the minimum queue length have been completely 
obtained for this generalized model in [gj]. We can use the present formulations by a 
QBD process and a reflecting random walk. However, even for k = 2, the answer is very 
complicated because A* (z) of the QBD process may not be positive recurrent. Thus, the 
random walk approach may be more suitable for such a generalization. 

Including this generalization, various modifications of the M/M-JSQ can be described 
by a multidimensional reflecting random walk with skip free jumps. Thus, it is very 
interesting to solve the tail asymptotic problems for a general multidimensional reflecting 
random walk. Some related results can be found in 0, @]- The approach in this paper 
may be useful to get the rough and exact asymptotics of the multidimensional reflecting 
random walk. 

Acknowledgements 

The authors would like to thank the referees for their valuable comments and suggestions. 
This research was supported in part by Japan Society for the Promotion of Science under 
grant No. 24310115. 

References 

[1] BREMAUD, P. (1999). Markov chains: Gibbs field, Monte Carlo simulation and 
queues. Springer, Berlin. 



18 



Foley, R. and McDonald, D. (2001). Join the shortest queue: stability and exact 
asymptotics. Annals of Applied Probability, 11 569-607. 

Kingman, J. F. C. (1961). Two similar queues in parallel. The Annals of Mathe- 
matical Statistics, 32 1314-1323. 

Kobayashi, M. and Miyazawa, M. (2011). Tail asymptotics of the stationary 
distribution of a two dimensional reflecting random walk with unbounded upward 
jumps. Preprint. 

Latouche, G. and Ramaswami, V. (1999). Introduction to matrix analytic meth- 
ods in stochastic modeling. ASA-SIAM Series on Statistics and Applied Probability, 
Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA. 

Li, H., Miyazawa, M. and Zhao, Y. Q. (2007). Geometric de- 
cay in a QBD process with countable background states with applications 
to a join-the-shortest-queue model. Stoch. Models, 23 413-438. URL 



http : //dx . doi . org/10 . 1080/15326340701471042 



MEYN, S. and TWEEDIE, R. L. (2009). Markov chains and stochastic stability. 2nd 
ed. Cambridge University Press, Cambridge. 

Miyazawa, M. (2009). Two sided DQBD process and solutions to the tail decay 
rate problem and their applications to the generalized join shortest queue. Advance 
in Queueing Theory and Network Applications, 1 3-33. 

Miyazawa, M. (2011). Rejoinder on: light tail asymptotics in multidimensional 
reflecting processes for queueing networks. TOP 1-4. 

Miyazawa, M. and Zhao, Y. Q. (2004). The stationary tail asymptotics in the 
GI /Cr/l-type queue with countably many background states. Adv. in Appl. Probab., 



36 1231-1251. URL http : //dx . doi . org/10 . 1239/aap/1103662965 



NEUTS, M. F. (1981). Matrix- geometric solutions in stochastic models: an algorithm 
approach. The John Hopkins University Press, Baltimore, MD. 

Puhalskii, A. A. and Vladimirov, A. A. (2007). A large deviation principle for 
join the shortest queue. Mathematics of Operations Research, 32 700-710. 

Sakuma, Y. (2010). Asymptotic behavior for marp/ph/c queue with shortest queue 
discipline and jockeying. Operations Research Letters, 38 7-10. 

Sakuma, Y. (2011). Asymptotic behavior for marp/ph/2 queue with join the short- 
est queue disciplin. Journal of the Operations Research Society of Japan, 54 46-64. 

Takahashi, Y., Fujimoto, K. and Makimoto, N. (2001). Geometric decay of 
the steady-state probabilities in a quasi-birth-and-death process with a countable 
number of phases. Stochastic Models, 17 1-24. 



19 



A Proof of Lemma 



EL 



Let S(h) = {i <E J; h <E 7-L, hi = 0}, that is, the set of severs having minimum queue. For 
its proof, we give detailed form of A\ for % — 0, ±1. For h, h G "H, we recall that [A]/^' 
is the (h, h')-th block of A{. 



(a) Entries of A + i : In this case, the minimum queue length increases by 1. This 
implies \S(h) \ = 1. If S(h) = {i}, arriving customers join the queue i, and the 
difference of queue length between queue j and the minimum queue decreases by 1 
for j 7^ %. Hence, we have 

[A +1 ] h , h - 1+ei = X, hen, \S(h)\ = l,i e S(h). 



(b) Entries of Aq : The level is unchanged. When a customer arrives, it is required 
that 1^(^)1 7^ 1 and the arriving customer joins queue i G S(h) with probability 
\S(h)\~ l , which changes the background state from h to h + e^. Hence, we have 

[A ] h , h+ei = \S(h)\~ x X, hen, \S(h)\ + \,%e S(h). 

When a customer finishes service, it must be at queue j G J \ S(h), by which the 
difference of queue length between queue j and the shortest queue decreases by 1. 
Hence, we have 

[A ) h ,h- ej = Vj, hen,j eJ\ S(h). 



(c) Entries of A_x : This case implies minimum queue length decreases by 1. That is, 
service completes at queue i G S(h), by which the background state changes from 
h to h + 1 — ej. Hence, we have 

L4„i]fc ;h+ i_ ei = Hi, h en,i e S(h). 

Proof of Lemma 13.11 For h e n, y = (y h ) and S(h) e K satisfying \S{h)\ = 1 and 
i e S(h), from (a), (b) and (c), the h-th element of A*(z)y is given by 

Substituting z = p~ k and yh 
[A*{p- k )y\ h = = 



where we use our assumption (12.21) for the last equality. 



p hl into this equation, we have 



P k IMP 



p- hl 
Vh, 



^pjP + Xp 1 
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We next consider 2 < (S^/i)! < k. Then, from (b) and (c), we have, for h G 



\S(h)[ 

i&S{h) jeJ\S(h) i€S(h) 1 v n 



lh+ ei 



Hence, we have 



[ A *{p )y\h = 2^ p w + ^ +xp 

ieS{h) j£S(h) 
k 



Vh- 



□ 



B Proof of Lemma 13.2 



From the Foster's theorem (see e,g., [H, 0|), for some e > 0, it is sufficient to find a function 
/ and finite set T C H such that 

iDf /(fc)>-oo, (B.l) 

J2Ph,h'f(h') <oo for all h e T, (B.2) 
H'eH 

J2Ph,h'f(h')-f(h)<-e iora\lhen\T, (B.3) 
H'eH 

where Ph,h' are the (h, h')-th entry of Ay 1 A*(p~ k )A y . The entries of the stochastic matrix 
A~ 1 y4*(p _fe )A y is given by the following forms. 



For \S(h)\ = 1, 



PhM 



For 2 < < k, 



Ph,h' 



Ap^ 1 , h' = h- 1 + ej, i 6 5(h), 
PiP, /i' = fa + 1 — ej, i G S(h) 

or h 1 = h — ei, i E J \ S(h), 
0, otherwise. 



h' = h + e i: i £ S(h), 
HiP, h' = h + 1 — z G S'(h) 

or h' = h — ei, i e J \ S(h), 
0, otherwise. 
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For h = (h±, h 2 , . . . , hk) G H, let 

k— 1 A: 

j = l m=j+l 

For this /, we obviously have (IB. II) . We note that % G S(h) implies hi = 0. For i G S(h) 
and h' = h — 1 + or h! = h + e*, we have 



(hj-h m ) 2 , j,m^i, 
(h' j -h'J 2 ={ (h j -h m ) 2 -(2h j -l), j<m = i, 
(hj - h m ) 2 - (2h m - 1), j = i < m. 



Thus, we have 



PH,H>J{ti)= = ^^(E E {h j -h m )*-'£(2h j -l)- £ (2/^-1) 



'ifc-i fe j-i 



v j'=l m=j+l j=l m=i+l 



Similarly, for h' = h + 1 — and % G S(h), 



Ph,h>f(ti) = fap yf(h) + E hj + ^—-^J 



For h! = h — ej and z G J \ S(h), we also obtain, 

(hj-h m ) 2 , j,m^i, 

(h'j - h'J 2 = { (hj - h m ) 2 + 2(hj -h m ) + l, j < m = i, 

(hj - h m ) 2 + 2(h m - hj) + 1, j =i < m, 



so we have the following inequality. 



Ph,h'f(h') = /lip (f(h) + E (hj -hi + ^)+ Yl ( hr 

\ j=l ^ ' m=i+l > 



, 1 

h i+ ~ 



M \ f(h) + J2 h i 



k-1 
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From (12. 2p . we have 



Ewco < E (/(")- E^ + ^i 1 

tieu ieS(h) 1 y n \ j=i 

( k k-1 

ies(h) V 3=1 

( k k-1 

ieJ\S(h) \ 3=1 

k-1 



2 

Thus, from the stability condition (12. II) . (IB. 21) and (IB. 3 1) hold with 

fc -1 + e 



J* = < h G H;hl< 



We complete the proof. 



C Proof of Lemma 13.3 



It suffices to prove that there exists a such that 

E( e °VI&?) < oo, (C.l) 



since prove (IC.ip . we consider a Lyapunov function 

such that 



,2 



/(u) = e <VE?=i«? 
for n, = («!, w 2 , • • • , Mfc) G , and, for each /3 > 0, define 



Obviously, Fp is a finite set. To verify (1C.1J) . if we can show that 



E{f{L n+1 )\L n = u) - /(«) < - Cl /(u), Vu G Z^ \ Fp, (C.2) 
for some Ci > 0, then, for any u G Z+, 

E(/(L n+1 )|L n = u) - (1 - Cl )/(«) < s(«), 
where s is a function defined 

s(u) = (E(/(L n+1 )|L n = «)-(!- Cl )/H) + l(u G i^). 
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Thus, by Theorem 14.3.7 of Q, we have 



ci f( u W( L = u) = ciE(e a v / EET^!) < ^ s(u)P(£ = u) < oo, 



which implies ( IC.lj) . We will show that, for < a < yklogp we can find (3 > such 
that fl02|) holds. 

For u G Z + , , let U£ = (u^, Ui 2 , . . . , U£ k ) be a permutation of u satisfying 

u £l <u e2 < ■■■ < u lk . (C.3) 
We exclude the case = ue 2 = ■ ■ ■ = ui k = 0, that is, we assume the following condition. 

0<u tj , 3jeJ. (C.4) 



Then, for j G J satisfying (1C.4I) . it follow from the transition matrix of the original queue 
length process {L^ t G Z + } that 



E(f(L n+1 )\L n = u)-f(u) = AeVK+DHE^ + ^^ e VK-^« 



where we have used (12. 2p to get the second equality. Note that \/I + u < 1 + | for u > — 1, 
so we have the following inequalities. 



\ 



k + 1) 2 + E 



i=2 



i) 2 + E 



r\ 1 



1 + 2m £i 



< r + 



1 + 2^ 
2r 



n 1 



1 - 2u e . 



< r 



1 - 2u e 
2r~ 
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where r = yY^'i=i u i i - Hence, we have 

E(f(L n+1 )\L n = u)-f(u)) 

i=j 



e ar + — 2^ 



Ae r + } ^.e 



k 

i=j 
k 



Hi 



i=3 



f(u) eZ Ae r 1 +J2^ e ^ )- ( A + J2 



Hi 



From this inequality, for a small a > and a large > 0, it is enough to find ci > such 
that 



A + 5>/ 4 ]<-ci, VuGZ+\J>. (C.5) 



For this, for a small 5 > 0, we partition two cases — ^- < 5 and — ^+ > <£■ From our 
assumption (IC.3j) and (1C.4[) . we have 



0< — < 1, i = l,2,...,A;, 
r 

Uf, 1 

< — < 



1 M ^ 

< _Et < i. 

First assume that < 5. In this case, from (10.6|) and ( lC.8p . we obtain 



(C.6) 
(C.7) 

(C.8) 



e+ r [ Ae r + Jj^ e ~^ I - I A + 

i=j / \ i=j 

(fc-1 
Ae >- + 2_^Hi + H k e ^ 

= A (e^+ 5 - 1) - /i 4 (l - e _ &) . 



i=j 



Then, for small a satisfying < a < \/~k\ogp 1 , there exist sufficiently small 5 and large 
/3 such that 



d x = A (e^ +S - 1) - m h {\ - e 7E) < 0. 



(C.9) 



We next consider the case — — > 5. Then, it implies that u\ > 0. From flC.3j) and 
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k m< \ / k 

i=j / \ i=j 



k 

au £ ■ 



= (l + e*-l) IXe^+J^^e-^j - f X + J^^, 

/ k \ / k 

< (1 + e # _ 1) I Ae— + JJ^e-— I - ( X + J2^ 

k \ / 

au £\ \ a. I au £^ au £- 

e ~ I + (e^ — 1) I Ae r + } ^/A^.e r 







( e r 


-)( 


/ au e 1 


-')( 


( e r 



8=1 / \ 1=1 

fe \ / k 

H U e r I + (ear 

i=l / \ 



1) Aevi + ^^ 

V i=i 

< (e s -l) U-J2^ e '^J -1) ^Ae^+^^j , 



where the last inequality is given by — > 5 and 

k k 



i=l i=l 



for < a < \/k\ogp 1 . Thus, for fixed a and 5, we obtain (1C.5I) for sufficiently large 
(3 > satisfying 

We put ci = — max(di, d 2 ). Then, from (10.91) and (IC.lOp . we have c\ > and (10.5|) . This 
completes the proof since <p(0,91) < E(e ^i=i Li ) for any 6* > 0. 



D Proof of Lemma 3.4 



We prove (13.1 6ft . For this, we apply truncation argument for the moment generating 
functions <pou and <p+v- For each n — 1,2,..., let 

g n {x) = min(x,n), iGR. 

Then, for any x, y G R, it is easy to see that 

9n(x + y)<g n (x) + l y X x ^2 W 
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The moment generating function E(e 9n ^ ez ^) is finite for each n and any G So, we 

have, by the stationary equation (12. 9p . 



Since is independent for Z, from fID.ip . we have, for any U G /C, 



E (e^( 0Z+ex(+C/) )l(Z, G 5 +f7 )) < E ^»(^)+«x(+^ 1(z e 5+f/) 0Z < ^ 

+E (e s " (ez) l(Z G 5+ a , 0Z > n)) 
= >y +u (e)E (e^( 0Z h(Z G 5 +f7 , 0Z) < n) 
+E (e 9 " (0Z) l(Z G 5 +t7 , 0Z > n)) . 

We have similar result for X^). By the decomposition of E(e 9n ^ 0Z ' ) ), 

£(1 - 7+£/(0))E (e^ z h(Z G 5 +C7 , 0Z < n)) 

< J2^u(0) - 1)E (e^ z h(Z G S w , 6Z < n)) . 

c/e/c 

Hence, we obtain ( 13 . 16f) as n -)■ oo by the monotone convergence theorem. We complete 
the proof since we can use a similar argument to ( I3.19p . 



E Proof of Corollary 12.1 



As we already noted, we only need to prove that 

limsup-logP(M = n) < logp k . (E.l) 

n— too fl 

From Lemma [3 .5[ we have, for r] < logp~ fc and < rji < r^-j logp~ fc , 
e^ n P(M = n)< E(e r ' oM ) < tp^rnl) < oo. 

Hence, 

r] n + logP(M = n) < log</?(?7o,77il), 

which implies that 

limsup — logP(M = n) < —t)q. 

n— >oo n> 



Thus, letting r] | log p k yields flE.lj) 
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